Goto

Collaborating Authors

 version space


Quantum Perceptron Models

Neural Information Processing Systems

We demonstrate how quantum computation can provide non-trivial improvements in the computational and statistical complexity of the perceptron model. We develop two quantum algorithms for perceptron learning. The first algorithm exploits quantum information processing to determine a separating hyperplane using a number of steps sublinear in the number of data points N, namely O( N). The second algorithm illustrates how the classical mistake bound of O( 1ฮณ2) can be further improved to O( 1 ฮณ) through quantum means, where ฮณ denotes the margin. Such improvements are achieved through the application of quantum amplitude amplification to the version space interpretation of the perceptron model.



Active Learning with Oracle Epiphany

Neural Information Processing Systems

We present a theoretical analysis of active learning with more realistic interactions with human oracles. Previous empirical studies have shown oracles abstaining on difficult queries until accumulating enough information to make label decisions. We formalize this phenomenon with an "oracle epiphany model" and analyze active learning query complexity under such oracles for both the realizable and the agnostic cases. Our analysis shows that active learning is possible with oracle epiphany, but incurs an additional cost depending on when the epiphany happens. Our results suggest new, principled active learning approaches with realistic oracles.




TowardsaUnified Information-Theoretic FrameworkforGeneralization

Neural Information Processing Systems

Let D be an unknown distribution on a spaceZ, and let H be a set of classifiers. Consider a (randomized) learning algorithmA = (An)n 1 that selects an elementห†h in H, based onn i.i.d.